Section: New Results

Continuous Control of Piecewise Deterministic Markov Processes with Long Run Average Cost

Participant : François Dufour.

Piecewise-deterministic Markov Processes, long-run average cost, optimal control, integro-differential optimality equation

The main goal of this work is to derive sufficient conditions for the existence of an optimal control strategy for the long run average continuous control problem of piecewise deterministic Markov processes (PDMP's) taking values in a general Borel space and with compact action space depending on the state variable. In order to do that we apply the so-called vanishing discount approach to obtain a solution to an average cost optimality inequality (ACOI) associated to the long run average cost problem. Our main assumptions are written in terms of some integro-differential inequalities related to the so-called expected growth condition, and geometric convergence of the post-jump location kernel associated to the PDMP.

These results have been obtained in collaboration with Oswaldo Luis Do Valle Costa from Escola Politécnica da Universidade de São Paulo, Brazil.

It has been published in the book Stochastic Processes, Finance and Control. A Festschrift in Honor of Robert J. Elliott [51] .